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This brief review of research examines the mail 
questionnaire as a research tool. Major topics reported are the 
advantages and disadvantages of mail surveys response rates, and 
questionnaire construction. Among the advantages reported are ease of 
distribution and tabulation, the possibility of a large sample and 
geographic range, low cost, uniformity of questions, convenience of 
response, and reduction of bias. Among the disadvantages are 
impersonal feelings, possible low rate of response, inability to 
interact with respondents, and lack of assurance as to the actual 
respondent. Strategies for increasing response rate are identified. 
Personalized correspondence, pre-contact letters, special delivery 
mailing, and emphasis on benefit to the respondent tend to increase 
response rates. Design of the questionnaire, clarity of instructions, 
simplicity of response, and quality of cover letter are considered to 
be impo'.tant. A pilot test of the questionnaire tc detect possible 
problems is recommended. (MDE ) 
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I NTRODUCT 1 ON 



For years mail questionnaires have endured as one of the 
most popular tools of educational research. In view of -the 
many advantages they offer reseachers, there are sound 
reasons why the use of questionnaires has continued to 
flourish as a method of data collection. Houever, attention 
must also be given to the deficiencies of mail surveys. In 
addition to the plusses and minusses of surveys other aspects 
of their use, such as questionnaire construction and cover 
letter design, must also be examined. The purpose of this 
paper is to present some of the considerations a reseacher 
must face when utilizing a mail questionnaire. 



ADVANTAGES AND DISADVANTAGES 



The appeal of questionnaires may stem from the many 
advantages they present to the researcher when deciding upon 
a data collection method. Long and Cognetta (1978) list 
several advantages of using a mail questionnaire including 
the relatively low cost, the possibility of reaching a large 
number of respondents, and the insurance that all respondents 
uill receive exactly the same questions. Humphries (1983) 
includes the opportunity to cover a uide geographic area, the 
ability to communicate with hard to reach subjects, the 
possibility of a large sample size, and the lou cost as being 
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good reasons to use a mail quest ionna irt . Moreover, Francis, 
Frey, and Harty (1979) also discuss the ability to cover a 
wide geographic area, cost effectiveness, and the insurance 
that all respondents will receive the same questions as 
advantages to using a mail survey. They go on to add that 
convenience cf response, ease of tabulation, and reduction of 
bias, because there is less pressure on respondents o-f mail 
surveys than there is in an interview situation, are other 
advantages . 

Although there may be many advantages to using a 
questionnaire as a tool for data collection, the researcher 
should also be aware of the shortcomings uh ich may occur a: a 
result of their use. Long and Cognetta (1978) include the 
possibility of a low response rate, the inability to clarify 
questions, and the impersonal feeling many people receive 
from a mail questionnaire. Humphries (1983) also lists the 
possibilty of a low response rate as a shortcoming of mail 
survys. He also includes the possibility of the actual 
respondent not being the one for whom the questionnaire was 
intended, and that no item can be considered independent from 
other items because respondents can read all questions before 
answering as added drawbacks. Francis, Frey , and Harty 
<1979> discuss the* chance of a low response rate as well as 
the possibility that answers to some items may be influenced 
by other items as be ing detr iments to ma il %urv^ys . 



FACTORS AFFECTING RESPONSE RATES 



A common assumption, by many researchers, is that the 
greatest weakness in the use of a mailed questionnaire to 
gather data is the low rate of response (Berdie, 1975), A 
low response rate may occur if the researcher has ignored the 
fundamental considerations that have been proven to have an 
affect upon the return rate of a mailed questionnaire such 
as: personalizing correspondence, making pre -contacts , and 
the use of multiple follow-up crntacts. Heberlein and 
Baumg^rtner (1978) state that, "The skilled researcher can 
successfully use the mailed questionnaire, but unlike the 
interview, which has the pouer of a face-to-face personal 
contact to stimulate response , the mai 1 ed quest ionnaire must 
rely on other techniques to assure response." 

A procedure that has been shown to increase the response 
rate of mail questionnaires is the personalizing of each 
correspondence . Throughout the 1 iterature findings indicate 
that the more "personalized" a survey appears to a potential 
respondent the more likely he or she is to return it. In one 
study. Champion and Sear (1969) found that a higher rm%pon%^ 
rate occurred as a result of using a common postage stamp as 
contrasted to machine printed postage permits. Similar 
results occurred in a study by Robin (1965) in which he 
states, "Research on this has shown that this is most 
effective, if sightly more expensive, when an actual stamp 
rather than a postal permit or a metered stamp is used." 



invariably result in additional responses.* The literature 
suggests that contacts may either be made by mail or by 
Phone. Heberlein and Baumgartner (1978) recommend that three 
contacts with the third being by phone are optimum. In 
another study (Robin, 1965> a minimum o-f two and a maximum of 
•five contacts, all by mail are recommended. Also, -follow-up 
contacts via mail do not appear to have to be in the -form o«f 
a letter. Sletto (1940) and LinsKy (1975) both -found 
postcards to be as e-f -feet ive as letters in stimulating 
response -from initial non -respondents . 

Two other procedures having a signi-ficant e-f-fect on the 
rate o-f response which a mail survey produces are the type o-f 
postage us«d, and the style o-f cover letter which accompanies 
the questionnaire. In their study. Champion and Sear (1969) 
used two types o-f cover letters. The -first group received an 
egoistic type o-f letter which emphasized the beni-fit the 
study would have to the respondent. The second group 
received an altruistic style letter which highlighted the 
individual's response as beni-fiting the researchers. They 
•found that a s ign i-f icant 1 y higher number o-f those receiving 
the egoistic style letter returned the questionnaire than did 
those receiving the altruistic type cover letters. In the 
same study (Champion and Sear, 1969) it was also -found that a 
s ign i-f icant 1 y greater number o-f surveys were returned by 
respondents receiving them by special delivery postage as 
compared to respondents receiving them through regular mail. 
However, it should be noted that the costs -for the special 
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delivery were considerably higher. 

A factor that many researchers may assume to have a 
significant effect on the response rate of a mailed survey is 
the length of the questionnaire. It seems plausible that the 
longer the questionnaire the less liKely a person would be to 
complete and return it. However, research pertaining to 
questionnaire length does not support this assumption. In 
one study (Sletto, 1940) potential respondents were sent 
questionnaires of 10, 25, and 35 pages in length. The 
results showed that the response rates for the 10 page, 25 
page, and 35 page questionnaires ware SB'/., 60X, and 63X 
respectively. Berdie <1975) distrubuted questionnaires of 
one, two, and four pages in length to 108 university 
professors. Although his results did show a negative 
correlation, i.e. as the length of the questionnaire went up 
response rates went down, the results were not statistically 
significant. In another study (Champion and Sear, 1969) 
questionnaires of three, six, and nine pages in length were 
mailed. The results of this study showed that a 
s ignif icantly higher number of nine-page quest ionnaires were 
returned than were three-page questionnaires. Oillman and 
Chr istenson (1974), sent out questionnaires ranging in length 
from 85 to 165 items. Even with the large numbers of 
quest ions that const ituted their surveys they experienced 
response rates of 70 to 75 percent. 
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QUESTIONNAIRE CONSTRUCTION 



The construction of the questionnaire itself is another 
important cons ider at ion -for the researcher . Long and 
Cognetta ( 1978 > divide the quest ionna ire into five parts. 
The first part is the heading. The heading includes the 
title and a statement of the purpose of the questionnaire. 
Second is the procedural statements. The procedural 
statements are brief statements that introduce formats and 
items. Third are the actual items. Fourth is comment space, 
as some room should be left for the respondents to record 
unsolicited Points of view or attitudes. The fifth part is 
the procedure for return. The procedure for return presents 
specific directions for returning the survey which should be 
as easy as possible for the respondents to follow. Lastly, 
the authors recommend that the questionnaire be pre-tested to 
detect any flaws before the actual mailing of it. 

In his article, Humphries (1983> also addresses 
questionnaire construction and format. He suggests that the 
researcher be familiar with many different Kinds of 
questions. The two question types Humphries describes are 
open-ended and c 1 osed -ended . Open-ended questions allow for 
respondents to answer freely and spon t anaeous 1 y as there are 
7>o choices for response as is the case with close-ended 
questions. He describes closed questions as being easier to 
answer, easier to tabulate, and lessening the chance of 
misinterpretation. Humphries also suggests that the 
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questionnaire should be Kept from becoming too lengthy, the 
responses to clostd questions should be arranged vertically 
under each item, and questions should be clearly seated and 
as specific as possible. Finally, he also recommends a 
Pilot-test of the questionnaire. 

Stacey and Moytr <1982) include in their suggestions for 
survey design the use of concise questions, the vertical 
arrangment of responses to closed questions, the avoidance of 
irrelevant items, and the use of a brief cover letter. As 
well, Spitzer (1979) also suggests that questions should be 
Kept brief and that a well-written and concise cover letter 
be used. He also suggests the grouping of items into 
categories, the use of simple and direct language, and that 
the first fey questions should be non -threaten ing and easily 
answered. Both articles, Stacey and Moyer (1982) and Spitzer 
(1979), al*o suggests a pre-test of the questionnaire to 
identify any problems that may exist in its design. 



SUMMARY 



Several advantages to using a mail questionnaire have 
been discussed including: the low cost involved, the! 
opportunity to cover a larger geographic area, the xj 
possibility of reaching a greater number of respondents, and 
the insurance that all respondents will receive exactly the 
same quest ions . Moreover , the opportun ity to corrvnun icate 
with hard to reach subjects, convience of response, ease of 
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tabulation, and reduction of bias are lso positive aspects 
of ma i 1 surveys • 

The disadvantages of utilizing a survey consist of: a 
possible lou response rate, the inability to consider items 
independent from one another, the incapacity to clarify 
questions, the impersonal feeling that many people receive 
from mail quest ionna ir as , and the possibility that the actual 
respondent may not be the one for whom a questionnaire was 
intended • 

To boost response rates the researcher should consider 
personal izing each correspondence, using multiple follow-up 
contacts and sending a pre-contact letter to potential 
respondents. In addition, special delivery postage and the 
use of an egoistic style cover both seem to increase response 
rates to mail surveys. Moreover, the length of a 
questionnaire does not appear to have a significant effect on 
the rate of return. 

Lastly, careful consideration should be given to all 
aspects of questionnaire design. It has been suggested that 
closed questions afford easier tabulation and rmspons^. 
However, open questions allow the respondent to answer more 
freely and imaginatively. The length and complexity of each 
item should be Kept us reasonable as possible to allow for 
easier completion. An emphasis should also be placed on a 
carefully designed and well-written cover letter to accorrpany 
the survey. Lastly, the importance of conducting a pilot 
test of any questionnaire to detect possible problems before 
it is actually milled out is essential. 
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